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[57] 



ABSTRACT 



A method and apparatus fox passive autoranging. Two 
cameras having different image parameters (e.g., focal 
gradients) generate two images of the same scene. A 
relaxation procedure is performed using the two images 
as inputs to generate a blur spread. The blur spread may 
then be used to calculate the range of at least one object 
in the scene. In one preferred embodiment, a temporal 
relaxation procedure is employed to focus a third cam- 
era. In another preferred embodiment, a spatial relax- 
ation procedure is employed to determine the range of 
a plurality of objects. 
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takes considerable time to acquire a two-dimensional 

METHOD AND APPARATUS FOR PASSIVE image. 

AUTORANGING USING RELAXATION It is also desirable, in the field of package shipping, to 

determine the heights of stacks of nested packages. 

BACKGROUND OF THE INVENTION 5 Robots are preferably used to place and remove pack- 

1. Field of the Invention ages from nested stacks for storage and/or shipping. To 
The present invention relates to autoranging, and, in function efficiently and automatically, the robots pref- 

particular, to passive methods and apparatuses for de- erably have information regarding the height of each 

tennining the range of one or more objects and/or for package stack. 

focussing a camera. 10 Subbarao (U.S. Pat No. 4,965,840) discloses the use 

2. Description of the Related Art of a pair of cameras with differing parameters and char- 
In the field of package shipping, it is desirable to have acteristics to image a scene for the purposes of either 

a camera positioned overhead a conveyor system to object range determination or autofocussing. The sys- 

read package labels as packages are propelled along the tern of Subbarao estimates blur spread, which may then 

conveyor system. Since package heights may vary 15 be used to determine object range and/or generate auto- 

greatly, the field of view of the camera may also vary focus parameters. However, the system of Subbarao 

greatly. It is therefore desirable to use a high-resolution employs an algorithm that requires knowledge of the 

camera (e.g., with a 4096-pixel linear array charge con- camera parameters for the pair of cameras, such as the 

pled device (CCD) sensor) to generate images of the aperture size, the focal length, and the distance between 

package labels. The camera system preferably provides 20 ^ principal plane and the image detector plane, 

autofocussing of the high-resolution camera to adjust j t ^ accordingly an object of the present invention to 

for the varying package heights. overcome the disadvantages and drawbacks of the prior 

One known technique for focussing an overhead an arid to provide an improved passive system for range 

camera employs a light curtain consisting of a one- determination and/or camera focussing, 

toensional vertical array of h^t-emitting diodes 25 IHsa object ofthe preseQt invention to pro- 

Of?)™?* ^rl 0 T^ enS10n ^ v^^y vide a system for passive autoranging without requiring 

of photctiansostors. The LED array is positioned on knowledge of camera parameters such as aperture 

one side of the conveyor to transmit radiation across the • JL U . . . , ^ , 

conveyor path toward the photo-transistor array posi- f °f between the second 
tioned on to other side of the conveyor. Package 30 prmcipal plane and the nnage detector plane, 
height is indicated by the lowest non-interrupted h^t ? tlS * ob ^ 1 of * e P^sent mvention to focus 
beam as the package passes between the LED and a ^-resolution camera positioned overhead a con- 
photo-transistor arrays. This height estimate is then ve y° r ? stem m ° rder to S enerate to read k bels 
used to focus the high-resolution overhead camera. on packages on the conveyor system. 

This technique of autoranging can only measure the 35 It is a further <*J«* of ^ present invention to deter- 
highest point of a stack of packages. Moreover, the mm£ tegfcte of a plurality of stacks of nested pack- 
resolution is limited by the density of LED/photo-tran- a £ es * 

sistor pairs in the matched arrays. It is a further object of the present invention to stabi- 
This technique of autoranging also employs active lize ^ blur-spread estimates to random variations of 
autofocussing, wherein radiation is generated with the 40 ^ ^ ata perceived images). Stabilized blur- 
specific purpose of focussing. Active autofocussing spread estimates imply more consistent and more accu- 
contrasts with passive autofocussing in which only am- Ta ^ e *&nge and focus setting calculations, 
bient radiation is required to perform the focussing Further objects and advantages of this invention will 
function. become apparent from the detailed description of a 

Another known technique for deterniining package 45 preferred embodiment which follows, 

height employs scanned-laser triangulation. In this tech- SUMMARY OF THE INVENTION 
nique, a laser spot is scanned across the package surface 

by means of either a gavanometer stepped mirror or by The present invention is a method and apparatus for 
a rotating mirror polygon. The range of the package is detennining at least one blur spread corresponding to at 
inversely proportional to the displacement of the re- 50 least one object. According to a preferred embodiment, 
fleeted spot as imaged by either a line-scan CCD array a first image of at least one object is provided, where the 
or by a lateral -effect photodiode (Le., a position sensing first image is generated by a camera having a first cam- 
device), era parameter. A second image of the object is also 

This technique takes considerable time to scan me- provided, where the second image is generated by a 
chanically the laser spot and limits the applicability of 55 camera having a second camera parameter different 
this technique to slow moving conveyor systems. In from the first camera parameter. A relaxation proce- 
addition, there is the risk of injury to people from the dure is performed in accordance with the first and sec- 
laser radiation. ond images to generate at least one blur spread 

Yet another known technique for detennining pack- According to an alternative preferred embodiment, a 

age height employs project ed-pattern triangulation. In 60 first image of at least one object is provided with a first 

this technique, either a single light strip or a pattern of camera having a first focal length, a first aperture size, 

light strips are projected onto a package surface. Dis- a first distance between a second principal plane and an 

placements of the projected light pattern imaged by a image detector plane of the first camera, and a first 

two-dimensional CCD array are inversely proportional camera parameter. A second image of the object is also 

to the range of the package. 65 generated, where the second image is generated with a 

Under this technique, the projected light pattern may camera having a second camera parameter different 

be difficult to see in the presence of intense ambient from the first camera parameter. At least one blur 

light used for the high-resolution camera. Moreover, it spread is generated in accordance with the first and 
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second images and independent of the first focal length, procedure to focus a high-resolution camera positioned 

the first aperture size, and the first distance of the first overhead packages on a conveyor system. Such a sys- 

camera. tern is described in further detail later in this specifica- 

An advantage of the present invention is that it pro- tion in conjunction with FIGS. 1-4. In another pre- 

vides autoranging passively, that is, using ambient radia- 5 ferred embodiment, a system according to the present 

tion. invention employs a spatial relaxation procedure to 

Another advantage of the present invention is that a determine the heights of a plurality of stacks of nested 

preferred embodiment may be used to provide passive packages. Such a system is described in further detail 

autofocussing of a camera. later in this specification in conjunction with FIGS. 5-7. 

Another advantage of the present invention is that an 10 „ ^ , ^ _ w _ 

alternative preferred embodiment may be used to deter- Focussing an Overhead Cameras Using Temporal 

mine the profile of heights of nested packages in stacks. Relaxation 

Another advantage of the present invention is that Referring to FIG. t, there is shown a block diagram 

preferred embodiments have no moving parts. of system 100 for passive autofocussing according to a 

Another advantage of the present invention is that 15 preferred embodiment of the present invention. System 
preferred embodiments . provide precise autoranging 100 includes conveyor belt 102, low-resolution, fixed- 
over relatively large depths of view. focus, dual-camera optics 104, focus sensing processor 

Another advantage of the present invention is that 106, label reader 108, and high-resolution, variable- 
preferred embodiments provide autofocussing in a rela- focus camera 110. Dual-camera optics 104 has optical 
tively short period of time and are therefore applicable 20 system 114 and camera hardware 116. Optical system 
to fast moving conveyor systems. 114 and camera hardware 116 are described in further 

BRIEF DESCRIPTION OF THE DRAWINGS ^^AZ^^ " C ° njUnCti ° n 

Other objects, features, and advantages of the present Package 112 is propelled along belt 102 passing first 

invention will become more fully apparent from the 25 under dual-camera optics 104 and then under high-reso- 

following detailed description of the preferred embodi- lution camera 110. As package 112 passes under dual- 

ment, the appended claims, and the accompanying camera optics 104, dual-camera optics 104 generates 

drawings in which: two images, each image perceived by cameras having 

FIG. 1 is a block diagram of a system for passive different focal gradients, of the top of package 112. 

autofocussing according to a preferred embodiment of 30 Both images are traiisrnitted to focus sensing processor 

the present invention; 106, which performs a temporal relaxation procedure 

FIG. 2 is a schematic diagram of the optical system of based on the two images to generate a blur-spread esti- 

the dual-camera optics of the system of FIG. 1; mate. Focus sensing processor 106 uses the blur-spread 

FIG. 3 is a block diagram of the camera hardware of estimate to calculate the focus distance for high-resolu- 

the dual-camera optics and the focus sensing processor 35 tion camera 110, which transmitted to label reader 108. 

of the system of FIG. 1; Label reader 108 uses the focus distance to focus camera 

FIG. 4 is a block flow diagram of the processing of 110 in time to generate a high-resolution image of the 

the system of FIG. 1; top of package 112 as package 112 passes under camera 

FIG. 5 is a block diagram of a system for deterniining 110. 

the heights of a plurality of stacks of nested packages 40 Camera 110 may be a conventional high-resolution, 

according to a preferred embodiment of the present variable-focus camera and is preferably a 4096-pixel 

invention; CCD line-scan array to enable perception of details on 

FIG. 6 is a block flow diagram of the processing of package labels. Label reader 108 may be any conven- 

the system of FIG. 5; and tional computing device and is preferably a special 

FIG. 7 is a block flow diagram of the processing of 45 purpose computer for decoding package labels. Con- 

the means of the system of FIG. 5 for updating the veyor belt 102 may be any conventional conveyor sys- 

blur-spread estimate for the current sample. tern. 

DESCRIPTION OF^THEPREFERRED J^SS tt«£2Z £££ 

tiMUUUiivuiXN of mQ t optical system 114 includes objective lens 
Preferred embodiments of the present invention are 202, beamsplitter 204, small focal gradient camera 206, 
directed to systems for determining the range of at least and large focal gradient camera 208. Small focal gradi- 
one object from a blur-spread estimate, where the blur- ent camera 206 includes aspherical lens 210 and CCD 
spread estimate is generated via a procedure such as a line-scan array 212. Large focal gradient camera 208 
relaxation procedure that receives as input two images 55 includes neutral density filter 214, aspherical lens 216, 
of the object generated by cameras having different and CCD line-scan array 218. Aperture 220 of small 
image parameters such as focal gradients. Depending focal gradient camera 206 is smaller than aperture 222 
upon the application, systems according to the present of large focal gradient camera 208. 
invention may employ a temporal relaxation procedure In a preferred embodiment, ambient light is reflected 
to determine a single blur-spread estimate or a spatial 60 from the surface of a package and passes through objec- 
relaxation procedure to determine multiple blur-spread tive lens 202 to beamsplitter 204. Beamsplitter 204 trans- 
estimates. Each blur-spread estimate may be used to mits some radiation to camera 206 and reflects some 
determine the range of an object in the two images. radiation to camera 208. Cameras 206 and 208 simulta- 
Thus, when a spatial relaxation procedure is employed, neously generate images of the top of the package, 
the multiple blur-spread estimates may be used to deter- 65 Since cameras 206 and 208 have different aperture sizes, 
mine the ranges of multiple objects in the two images. cameras 206 and 208 have different f-numbers and dif- 
In one preferred embodiment, a system according to ferent focal gradients. Camera 206, having a relatively 
the present invention employs a temporal relaxation small aperture 220, has a relatively large f-number and a 
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relatively small focal gradient On the other hand, cam- conjunction with FIG. 4. Focus sensing processor 106 
era 208, having a relatively large aperture 222, has a also stores data to and accesses data from RAM/ROM 
relatively small f-munber and a relatively large focal memory 314 via primary bus 316. 
gradient Converters 302 and 304 may be conventional 8-bit 

The specific characteristics of the optical components 5 A/D converters and are preferably flash-type convert- 
of optical system 114 of dual-camera optics 104 depend ers. Interface 306 is preferably a custom-made interface 
on the particular application and may be selected empir- that allows transfer of camera data to RAM memory 
ically. In general, the larger the ratio of camera 206. 314. Buses 308, 310, and 316 are preferably conventional 
f-number to camera 208 f-number, the more accurate bit-parallel digital buses. Focus sensing processor 106 is 
are the blur-spread estimates and hence the more accu- 10 a digital signal processor preferably based on a Texas 
rate are the generated ranges. The specific component Instruments TMS30C3O Processor. Interface 312 is 
characteristics described below apply to a preferred preferably a custom-made interface. Memory 314 is 
embodiment of the present invention designed to pro- preferably a mixture of static RAM and EPROM. 
vide a depth-of-view of approximately 24 inches and a Referring now to FIG. 4, there is shown a block flow 
fiddK)f.view of approximately 18 inches. 13 diagram of the processing implemented by system 100 

Leu 3tt may be a conventional biconvex objective of FIG. 1 for passive autofocussing of a high-resolution 
lens and preferably has a focal length of 3W mmjieam- according to a preferred embodiment of the 

spbtter 204 may be a conventional plate beamsplitter t mvention . According to this processing, the 

and u .preferably a 30/70 spht beamsplitter. Lenses 210 ^ ^ g^e^ by d ual<amera optics 104 are 
"*» ? nve °*^fP h ^f^f d ^ 20 Processed by focus sensing processor 106 according to a 

erably have focal lengths of 8^5 mm. Filter 214may be temporal relaxation procedure to generate a blur-spread 
a conventional neutral density filter and is preferably estjmat& ^ relaxa £ on procedur e fe m non .Hnear iter- 
selected empirically to prevent small f-number camera ^ procedure that is repeated until an acceptable 
208 I from saturating when a package remams within the b , ^ ^ g^ted. ^ blm ^ le ^ ^ 

field of view. Arrays 212 and 218 may be convention^ 25 ^ ^ ^ ^ to ^ focus used by 

CCD lme-scan arrays and are r^erably 256^ement ^ reader 108 to focus high-resolution camera 110. 

CCD line scan arrays. In a preferred embodiment, cam- T , , m am^t *nn *t. 

era 206 has an f-number of 12.5 and camera 208 has an J« 402 of system 100 acquires the 

f-number of 1.25. In alternative preferred embodiments, ^^S^fT ^ fr ° m smaU-a^rture camera 
f-numbers for cameras 206 and 208 are selected to pro- 30 f 06 °J 2. Simultaneously, step 404 acquires the 
vide an f-number ratio of greater than 10. ^l^'E^ T gC %T ^f^^^* 

Objective lens 202 determines the focal lengths of ^'J tep g^?*** a ^ Foune J 
cameras 206 and 208. Beamsplitter 204 allows cameras ^ ans ^ n of ^^"^e^ 

206 and 208 to generate simultaneous images with cam- ^P omt ^ ° f ^ ^f^" 

eras 206 and 208 oriented at right angles to one another. 35 f"*?* ^^^1 c * d ? ed b £ a 

Filter 214 attenuates the agnized by large-aper- f f ^? one 5 J f FI ^ c alg °7^ m ^ ch u as * e 

ture camera 208 to ensure that the images generated by ^Oua described m Digital Signal Pressing by Op- 
cameras 206 and 208 have similar intensity levels. Penheim aad Schafer, Prentice-HaU, 1975. 
Aspherical lenses 210 and 216 provide space for beam- Ste P 41 * tw0 ^ s of *f t0 

spUtter 204 and permit optimization of the optical char- 40 5*™?* ^ raw gam k and blur spread <r according to 
acteristics of optical system 114 for the wavelengths of E ^ uatlons W and C9 below: 
the ambient light In a preferred embodiment, the ambi- 
ent light is generated by a sodium arc lamp which illu- ✓ . . ^ 0) 
minates packages for high-resolution imaging by cam- 
era 110 of FIG. 1. 45 

Referring now to FIG. 3, there is shown a block K = exp 

diagram of camera hardware 116 of dual-camera optics 
104 and focus sensing processor 106 of FIG. 1 accord- 
ing to a preferred embodiment of the present invention. 
CCD line-scan arrays 212 and 218 are the arrays of 50 * nd 

cameras 206 and 208, respectively, as shown in FIG. 2. ^ 

Arrays 212 and 218 transmit analog pixel data to 8-bit 1 
A/D converters 302 and 304, respectively. The digi- 
tized pixel data is then transmitted to camera interface <r 
306 which stores the digital pixel data for transmission 55 
to focus sensing processor 106 via expansion bus 308. 
Bus 310 provides direct memory access (DMA) control 
lines allowing direct access to RAM memory 314 from where: 
camera interface 306. Camera interface 306 transfers 

image data directly to memory 314, independent of 60 [log /%) - tog PM 

focus sensing processor 106. J 

Focus sensing processor 106 employs a relaxation ^ 
procedure to process the two digital images generated 

by cameras 206 and 208 to calculate the focus distance » n . _ 

for high-resolution camera 110, which is transmitted to 65 w== y ri 8 rN) 108 

label reader 108 via interface 312. The relaxation proce- where P/Q) is sample j of the power spectrum P/ of the 
dure implemented by focus sensing processor 106 is large-focal-gradient image; PXj) is sample j of the 
described in greater detail later in this specification in power spectrum P* of the small-focal-gradient image; 
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and N is the number of pixels in each image. The power 
spectra P/and P^are generated according to Equations 
(3) and (4) as follows: 



and 



where D/ is the 2N point DFT of the large-focal-gradi- 
ent image generated by step 408; D s is the 2N point 
DFT of the small-focal-gradient image generated by 
step 406; D/* is the complex conjugate of Dr, and D/ is 
the complex conjugate of Dj. 

Step 412 generates the transform G of the time-vary- 
ing regularization vector according to Equation (5) as 
follows: 



, k exp 



(5) 20 



, icexp 



(-*->■]■ 



25 



Step 414 generates an estimate of the transform H of 
the impulse response of dual-camera optics 104 of FIG. 
1 according to Equation (6) as follows: 



30 



ET= <fagona1 



[ w+ * } 



(6) 



35 



where X* is the complex conjugate of X; X is the diago- 
nal matrix of the DFT of the small-focal-gradient im- 
age, such that X= diagonal [Xy; k=0, 1, . . . , 2N— lfc u. 
is the fixed regularization parameter; x/ is the complex 
conjugate of xj; and x/ is sample [jj] along the diagonal ^ 
of the DFT of the small-focal-gradient image. The fixed 
regularization parameter \i may be empirically deter- 
mined and preferably has a value of 100. The value of 
regularization parameter u. is selected empirically to 
provide a good fit to the camera model and sufficient 45 
dynamic range of blur-spread estimates. The larger the 
value of pi, the smaller the dynamic range, but the better 
the fit to the camera model. 

Step 416 updates the current estimates for the raw 
gain k and the blur spread tr according to Equations (7) 50 
and (8) as follows: 



k = exp 



and 



(7) 



(8) 



M 

where: 



8 

-continued 



0) 5 



and 



G0) = 2/*tog[ff(^«tt)] 



10 



15 



Step 418 generates the current squared error ^squared 
according to Equation (9) as follows: 



B sq u an d = "V (log ^WO^)] - k + -2^-) 



(9) 



where H(j) is the j rt sample of the transform H of the 
impulse response of dual-camera optics 104 and H*(j) is 
the complex conjugate of HQ)* 

Step 420 then determines whether the current blur- 
spread estimate <r is acceptable by testing for conver- 
gence of the squared error Esquared> In a preferred em- 
bodiment, step 420 determines whether the magnitude 
of the difference between the current squared error and 
the previous squared error (i.e., the squared error from 
the previous iteration cycle) is less than or equal to a 
specified threshold. If not, then the squared error has 
not yet sufficiently converged and processing returns to 
repeat the processing of step 412 through 420. Process- 
ing continues to iterate until step 420 determines that 
the squared error has converged. At that time, process- 
ing proceeds to step 422. 

Step 422 calculates the focus distance d/for high-reso- 
lution camera 110 according to Equation (10) below: 



( C2 + <r ^ 



(10) 



where cj t C2, and C3 are calibrated values for mapping 
from large-aperture camera 208 to high-resolution cam- 
era 110. 

The values for ci, 02, and C3 are determined during a 
two-step calibration procedure. The first step is to ac- 
quire a N sets of pairs of focus distances d/ and blur- 
spread estimates 07 by manually focussing high-resolu- 
tion camera 110 on packages of different heights and 
detennining the corresponding blur-spread estimates in 
images generated with dual-camera optics 104. The 
second step is to solve a set of three linear equations that 
minimize the cost function E with respect to ci, ca, and 
K, where the cost function E is given by: 



55 



N 

' ,=i <cy,< - no-/ - r + dtcrip 



After step 422 calculates the focus distance dt, step 
60 424 then focusses high-resolution camera 110 based on 
the calculated focus distance di. In a preferred embodi- 
ment of the present invention, focus sensing processor 
106 implements steps 402 through 422 and label reader 
108 implements step 424. 
65 Those skilled in the art will understand that dual- 
camera optics 104 and focus sensing processor 106 may 
be designed for a range-finding system that determines 
the distance between dual-camera optics 104 and an 
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imaged object Such a system may or may not focus a ates a backward blur-spread estimate and a backward 
camera. cost function value for each sample during the back- 
Those skilled in the art will also understand that ward pass. If the backward cost function value for a 
means other than dual-camera optics 104 may be used to particular sample is less than the forward cost function 
generate the two images that are inputs to the relaxation 5 value for the same sample, then focus sensing processor 
procedure of the present invention. For example, two 504 updates the range value for that sample using the 
cameras having different parameters such as aperture backward blur-spread estimate. When the backward 
size, focal length, and/or distance between the second pass is complete, focus sensing processor 504 will have 
principal plane and the image detector plane will have generated a set of range values, each of which corre- 
different focal gradients and may be used to generate 10 sponds to a different image sample and therefore to a 
the two images. Moreover, a single camera may be used different position within the field of view of dual-cam- 
to generate the two images if the focal gradient of the era optics 502. These range values can then be used to 
camera is changed from one image to the other. determine the various heights of the stacks of nested 



h<0)=[10...0]' (13) 

(H) 



Multiple Range-Finding Using Spatial Relaxation t _J i ™* r - 

15 In particular, step 602 of focus sensing processor 504 

Referring now to FIG. 5, there is shown a block acquires corresponding images from the large-aperture 

diagram of system 500 for determining the heights of a and small-aperture cameras of dual-camera optics 502. 

plurality of stacks of nested packages according to a Step 604 initializes the preferred spatial relaxation algo- 

preferred embodiment of the present invention. System rithm according to Equations (11)— (14) below: 

500 includes low-resolution, fixed-focus, dual-camera 20 

optics 502 and focus sensing processor 504. R(p)=o (11) 

Dual-camera optics 502 is positioned above a plural- _ 
ity of stacks of nested packages 506. Dual-camera optics ©(p)=0 (12) 
502 has two cameras with different focal gradients and 
generates two images of the tops of the stacks of nested 25 
packages 50e within the field of view of dual-camera o<p)=to 
optics 502. Both images are transmitted to focus sensing 
processor 504, which performs a spatial relaxation pro- where R(0) & ^ hiiti^i^ covariance matrix; O(0) is 
cedure based on the two images to generate a blur- ^ initialized cross-correlation vector: w(0) is the mi- 
spread estimate for each image sample (lc, pixel). Each 30 ti ^ zed wdght vector ^ ^ ^ ^ infr^ed blur- 
image sample corresponds to a different position in the spread estimate. 

field of view of dual-camera optics 502 Focus sensing step 606 selects the next forward sample n, where 

processor 504 calculates a range value from each blur- n== i,_, M , where Mis the number of samples in each 

spread estimate, where each range value corresponds to step 608 then updates the blur-spread estimate 

the height of a stack of nested packages 506. 35 for ^ current sample. 

In a preferred embodiment of system 500, the hard- Referring now to FIG. 7, there is shown a block flow 
ware of dual^amera optics 502 and focus sensing pro- diagram of the processing of step 608 of FIG. 6 for 
cessor 504 is identical to that of dual-camera optics 104 updating the blur-spread estimate for the current sam- 
and focus sensing processor 106 of system 100 of FIG. ple . Step 702 0 f step 608 sets up a data vector u(n) ac- 
1, respectively. The processing implemented by focus 40 cording to Equation (15) below: 
sensing processor 504, however, differs from the pro- 
cessing of focus sensing processor 106. «0»)« W«X *(»- !)+*(«+ 0, 

Referring now to FIG. 6, there is shown a block flow *(n- J/+ i)+*(n-Mf- 1), i y (is) 
diagram of the processing of focus sensing processor 

504 according to a preferred embodiment of the present 45 where x(n) is the n rt sample from the small-focal-gradi- 

invention. Focus sensing processor 504 uses the two ent image. 

images generated by dual-camera optics 502 of FIG. 5 Step 704 updates a spatially variant forgetting factor 

as inputs to a spatial relaxation procedure. The spatial *(n) according to Equation (16) below: 
relaxation procedure includes two spatial passes 

through the image data: a forward pass in one direction 50 <i _ x^n) (16) 

and a backward pass in the opposite direction. *W = + ^ 

During the forward pass, focus sensing processor 504 ** 

sequentially selecU samples from the large-focal-gradi- where x ^ ^ a ^ mm forgerdng factor va j ue ^ 

ent image generated by die large-aperture camera of fiisascaic factor . ^ mh ^ D} ^ forgetting factor value 

dual-camera opucs502and corresr^ndmg samples from 55 x ^ ^ scak factor 0 be empirically deter- 

thesm^-focal-gradient image generated by the small- ^ ^ vallles of 0 . 90 and 1.0, re- 

aperture camera of dual-camera optics 502. Focus sens- soectivelv 

ing processor 504 generates a forward blur-spread esti- % ?06 ^ ^ crosSK:orrelation vector ©( n) 

mate for each sample psur. Each blur-spread estimate is recur £ veI to Equation (17) below: 
based m part on the blur-spread estimates for the previ- 60 

ously selected samples. From each blur-spread estimate, e(n)=MfljS(n- i)+d(nyn(n) (17) 
focus sensing processor 504 calculates a forward cost 

function value and a range value, where d(n) is n rA sample from the large-focal-gradient 

After the forward pass is complete, focus sensing image, 

processor 504 performs analogous processing in a back- 65. step 708 updates the covariance matrix R(n) recur- 

ward pass through the image data, in which the image sively according to Equation (18) below: 
samples are selected in the opposite order from those in 

the forward pass. Focus sensing processor 504 gener- R(n)=\(n)R{n-\)+u{n)u(n) (18) 
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_ _ The four constraint functions cj^w(n)) are given by 

where u'(n) is the transpose of the data vector u(n). Equations (24H27) below: 

Step 710 sets up a gradient vector VE(n), which is the 

derivative of a scalar cost function E(n) with respect to 2 

a weight vector w(n). Step 712 sets up a Hessian matrix 5 C i(s<n)) = M £ 1 [w k - hq cxp ( VI 

H(n), which is the second derivative of the scalar cost *-i L \ ^H* - l ) J J 
function E(n) with respect to the weight vector w(n) 

and is given according to Equation (19) below: / . \ M - 1 (25) 



10 



Cj(R<iO)< , 7 _ 



d * nM _ rfW -!!-*-■» II* » 
The weight vector w(n) and the scalar cost function 

E(n) are given below by Equations (21) and (23), re- 15 = || II* 

spectively. The gradient vector VE(n) and the Hessian d ^ 

matrix H(n) are computed using the weight vector , . , . , „ . . 

w<n-l) and blur-spread estimate <r<n-l) from the where w 0 is the 0* element of Ae weight vector w(n) 

previous sample n-1, but using the data vector u"(n) ■** «*<n-l) * the square of the blur-spread estimate 

from the current sample n. ™ previous sample (n- 1). The first and second 

Step 714 factors the Hessian matrix H(n) into the derivatives in Equations (26) and (27) may be approxi- 

product of triangular matrices by the Cholesky reduc- mated **»rikg t0 Equations (28) and (29) below: 
tion algorithm, as described in Introduction to Matrix 

Computations, by Stewart, Academic Press, 1973. _ d ^ „ ^ _ ^ _ ^ (28) 

Means 716 determines a weight change vector Aw(n) 25 dn 

by solving a triangulation equation given by Equation ^ (29) 

(20) below: ~r ~ W ~ 2 .*C" - 1) + »C« - 2> 

.HCn>AH</i)- V£(«) <20) w h ere ^( n ) ^ ^ i oca i average of past weight vectors 

Ste P 718ur^testheweightvectorw(n)ac C ordingto 3 ° *nd is generated according to Equation (30) below: 
Equation (21) below: 

^-SSCn-O-aAJKn) (21) P y=n-p+l ^" 

where a is the learning rate. The learning rate a may be 35 where p is an integer that specifies the number ofprevi- 

empirically determined and preferably has a value of ous samples used to generate the local average w(n). p 

10. may be empirically determined and preferably has a 

Step 720 updates the bhir-spread estimate o-(n) for the value of 3.0. 

current sample n according to Equation (22) below: ^ After step 610 updates the forward cost function 

E(nX step 612 calculates the local range z(n) for the 

<r(fl) «, (22) current sample n according to Equation (31) below: 



45 



* v ✓ \ / \f \ where z mt A, and B are calibration parameters, 

f 2*W J[ |^og(wj0 J- [l^jk 2 )[|* 2 H'jt 2 log(^ J The method of determining values for the calibration 

V /V ' ^ JK ' parameters z m , A,, and B for the spatial relaxation 

, _ 50 method is analogous to the two-step calibration method 

where w* is the k<* element of the weight vector w(n). f or the temporal relaxation method described earlier in 

Referring again to FIG. 6, after step 608 updates the this specification. The first step is to acquire a N sets of 

blur-spread estimate <r(n), step 610 updates the forward pa ir S Q f focus distances z/ and blur-spread estimates 07 

cost function E(n) according to Equation (23) below: by man uaUy focussing high-resolution camera 110 on a 

55 target with a known profile and detennining the corre- 

« — «f/-v-* «2 , 4 , , „ (23) sponding blur-spread estimates across an image gener- 

_ solve a set of three linear equations that minimize the 
where u f (i) is the transpose of the data vector u(i); jx* for cost function E with respect to B, z m , and C, where the 
k= 1,2,3*4 are four regularization parameters; and 60 0081 function E is given by: 
cjt(w(n)) for k= 1,2,3,4 are four constraint functions. 
The four regularization parameters may be empirically v 
deterrnined and preferably have values (u.= 100.0); £ " /=i ~~ Zm<r * ~ C + Zi(r ^ 
0t2=0.0t); (0-3= 1.0); and (04= 1.0). As with the tem- 
poral relaxation method, the values of the four regular- 65 where: 
ization parameters for the spatial relaxation method 
are selected to provide accurate blur/range estimates A*=*c/z m . 
and sufficient dynamic range. 
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Step 614 determines whether the forward pass 
through the image data is complete (i.e., whether every 
sample has been selected for processing). If not, then 
processing returns to step 606 to select the next forward 
sample for processing by step 608, 610, and 612. Other- 5 
wise, the forward pass is complete and processing con- 
tinues to step 616 to select the first sample for the back- 
ward pass through the image data. In a preferred em- 
bodiment, step 616 begins the backward pass by rese- 
lecting the last sample from the forward pass as the first 10 
sample for the backward pass. In addition, the relax- 
ation algorithm is preferably not reinitialized at the 
beginning of the backward pass. 

Step 618 and 620 update the blur-spread estimate cr(n) 
and cost function E(n), respectively, for the current IS 
sample n during the backward pass. In a preferred em- 
bodiment, the processing of step 618 and 620 is analo- 
gous to that performed by step 608 and 610, respec- 
tively, as already described above. As in the forward 
pass, during the backward pass, in computing the value 20 
of the cost function E(n), the term due to the data (i.e., 
the first summation in Equation (23) above) is averaged, 
while the term due to the constraints (ie., the second 
summation in Equation (23) above) is not averaged. 

Step 622 compares the backward cost function value 25 
with the corresponding forward cost function value for 
the current sample. If the backward cost function value 
is less than the forward cost function value, then step 
624 updates the local range value z(n) using the blur- 
spread estimate cr(n) from the backward pass. In a pre- 30 
ferred embodiment, step 624 employs processing analo- 
gous to that of step 612. 

Step 626 then determines whether the backward pass 
through the image data is complete. If not, then process- 
ing returns to step 616 to select the next sample in the 35 
backward pass. Otherwise, processing of focus sensing 
processor 504 is complete. The resulting range values 
z(n) correspond to the heights of the stacks of nested 
packages in the field of view of dual-camera optics 502. 

Those skilled in the art will understand that systems 40 
within the scope of the present invention may £e used to 
determine the distances between dual-camera optics 502 
and one or more objects other than stacks of nested 
packages. 

It will also be understood by those skilled in the art 45 
that systems falling within the scope of the present 
invention may employ relaxation methods other than 
the specific temporal and spatial relaxation methods 
described in this specification. For example, the cam- 
era's power spectrum may be estimated by regulariza- 50 
tion with a cylindrical sine function. Such a system uses 
the same temporal relaxation algorithm as described 
earlier in this specification in conjunction with FIG. 4, 
except that a cost function based on a cylindrical sine 
function in frequency is used instead of the gaussian- 55 
based cost function Beared of Equation (9) above. Such 
a system may be useful for optical testing (i.e., determin- 
ing just how well focussed a lens is or how well the 
details of a scene may be imaged). 

In another alternative preferred embodiment, a robot 60 
may used the spatial relaxation method to determine 
depth profiles for stacking packages or other opera- 
tions. 

It will be further understood that various changes in 
the details, materials, and arrangements of the parts 65 
which have been described and illustrated in order to 
explain the nature of this invention may be made by 
those skilled in the art without departing from the prin- 
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ciple and scope of the invention as expressed in the 
following claims. 
What is claimed is: 

1. A method for determining a differential blur spread 
corresponding to an object, comprising the steps of: 

(a) providing a first image of said object, said first 
image being generated by a camera having a first 
camera parameter; 

(b) providing a second image of said object, said 
second image being generated by a camera having 
a second camera parameter different from said first 
camera parameter; and 

(c) performing a relaxation procedure in accordance 
with said first and second images to generate said 
differential blur spread. 

2. The method of claim 1, further comprising the step 
of: 

(d) deterrnining a range of said object in accordance 
with said differential blur spread. 

3. The method of claim 2, further comprising the step 
of: 

(e) focussing a camera in accordance with said range. 

4. The method of claim 3, wherein said object is a 
package on a conveyor system and said focussed cam- 
era is a high-resolution camera positioned overhead said 
conveyor system to generate images used to read a label 
on said package. 

5. The method of claim 1> wherein said first camera 
parameter is a first focal gradient and said second cam- 
era parameter is a second focal gradient. 

6. The method of claim 1, wherein: 

step (a) comprises the step of generating said first 
image with a first camera having a first aperture 
size; and 

step (b) comprises the step of generating said second 
image with a second camera having a second aper- 
ture size, said second aperture size being different 
from said first aperture size. 

7. The method of claim 1, wherein: 

step (a) comprises the step of generating said first 
image with a first camera having a first focal 
length; and 

step (b) comprises the step of generating said second 
image with a second camera having a second focal 
length, said second focal length being different 
from said first focal length. 

8. The method of claim 1, wherein: 

step (a) comprises the step of generating said first 
image with a first camera having a first distance 
between a second principal plane and an image 
detector plane of said first camera; and 

step (b) comprises the step of generating said second 
image with a second camera having a second dis- 
tance between a second principal plane and an 
image detector plane of said second camera, said 
second distance being different from said first dis- 
tance. 

9. The method of claim t, wherein step (c) comprises 
the step of performing a temporal relaxation procedure 
in accordance with said first and second images to gen- 
erate said differential blur spread. 

10. The method of claim 1, wherein step (c) com- 
prises the steps of: 

(1) generating a 2N point discrete Fourier transform 
of said first image; 

(2) generating a 2N point discrete Fourier transform 
of said second image; 
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(3) generating a raw gain and said differentia] blur 
spread in accordance with said 2N point discrete 
Fourier transforms of said first and second images; 

(4) generating a transform of a time-varying regular- 
ization vector in accordance with said raw gain and 
said differential blur spread; 

(5) generating a transform of an impulse response in 
accordance with said time-varying regularization 
vector and said 2N point discrete Fourier trans- 
forms of said first and second images; 

(6) updating said raw gain and said differential blur 
spread in accordance with said impulse response; 

(7) generating a squared error in accordance with 
said impulse response, said updated raw gain, and 
said updated differential blur spread; 

(8) testing said squared error for convergence; and 

(9) repeating steps (c)(4) through (c)(7) in accordance 
with said testing of step (cX8). 

11. The method of claim 1, wherein step (c) com- 
prises the step of performing a spatial relaxation proce- 20 
dure in accordance with said first and second images to 
generate said differential blur spread. 

12. The method of claim 11, wherein: 

step (c) comprises the step of performing said spatial 
relaxation procedure in accordance with a forward 25 
pass through said first and second images to gener- 
ate a plurality of forward differential blur spreads 
and a plurality of forward cost function values; and 
further comprising the steps of: 

(d) determining a plurality of ranges corresponding to 30 
a plurality of objects in accordance with said plu- 
rality of forward differential blur spreads; 

(e) performing said spatial relaxation procedure in 
accordance with a backward pass through said first 
and second images to generate a plurality of back- 35 
ward differential blur spreads and a plurality of 
backward cost function values; 

(f) comparing said plurality of backward cost func- 
tion values with said plurality of forward cost func- 
tion values; and 40 

(g) updating said plurality of ranges in accordance 
with said comparison of step (f). 

13. The method of claim 1 ( wherein step (c) com- 
prises the steps of: 

(1) selecting a first first-image sample from said first 45 
image and a corresponding first second-image sam- 
ple from said second image; 

(2) generating a first differential blur spread in accor- 
dance with said first first-image and first second- 
image samples; 50 

(3) selecting a second first-image sample from said 
first image and a corresponding second second- 
image sample from said second image; and 

(4) generating a second differential blur spread in 
accordance with said second first-image and sec- 55 
ond second-image samples. 

14. The method of claim 13, further comprising the 
steps of: 

(d) detennining a first range value corresponding to 



packages and said second range value corresponds to 
the height of a second stack of nested packages. 

16. The method of claim l f wherein: 

step (a) comprises the step of providing said first 
image with a first camera having a focal length, an 
aperture size, and a distance between a second 
principal plane and an image detector plane of said 
first camera, and 

step (c) comprises the step of performing said relax- 
ation procedure independent of said focal length, 
said aperture size, and said distance of said first 
camera. 

17. An apparatus for determining a differential blur 
spread corresponding to object, comprising: 

(a) a camera, having a first camera parameter, for 
providing a first image of said object; 

(b) camera means, having a second camera parame- 
ter, for providing a second image of said object, 
said second camera parameter being different from 
said first camera parameter; and 

(c) means for. performing a relaxation procedure in 
accordance with said first and second images to 

. generate said differential blur spread. 

18. The apparatus of claim 17, further comprising: 

(d) means for determining a range of said object in 
accordance with said differential blur spread. 

19. The apparatus of claim 18, further comprising: 

(e) means for focussing a camera in accordance with 
said range. 

20. The apparatus of claim 19, wherein said object is 
a package on a conveyor system and said camera is a 
high-resolution camera positioned overhead said con- 
veyor system to generate images used to read a label on 
said package, 

21. The apparatus of claim 17, wherein said first cam- 
era parameter is a first focal gradient and said second 
camera parameter is a second focal gradient 

22. The apparatus of claim 17, wherein: 

camera (a) comprises a first camera having a first 
aperture size; and 

camera means (b) comprises a second camera having 
a second aperture size, said second aperture size 
being different from said first aperture size. 

23. The apparatus of claim 17, wherein: 

camera (a) comprises a first camera having a first 
focal length; and 

camera means (b) comprises a second camera having 
a second focal length, said second focal length 
being different from said first focal length, 

24. The apparatus of claim 17, wherein: 

camera (a) comprises a first camera having a first 
distance between a second principal plane and an 
image detector plane of said first camera; and 

camera means (b) comprises a second camera having 
a second distance between a second principal plane 
and an image detector plane of said second camera, 
said second distance being different from said first 
distance. 

25. The apparatus of claim 17, wherein means (c) 



said first first-image and second-image samples in 60 comprises means for performing a temporal relaxation 



accordance with said first differential blur spread; 
and 

(e) determining a second range value corresponding 
to said second first-image and second-image sam- 
ples in accordance with said second differentia] 65 
blur spread. 

15. The method of claim 14, wherein said first range 
value corresponds to the height of a first stack of nested 



procedure in accordance with said first and second 
images to generate said differential blur spread. 

26. The apparatus of claim 17, wherein means (c) 
comprises: 

(1) means for generating a 2N point discrete Fourier 
transform of said first image and for generating a 
2N point discrete Fourier transform of said second 
image; 
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(2) means for generating a raw gain and said differen- 
tial blur spread in accordance with said 2N point 
discrete Fourier transforms of said first and second 
images; 

(3) means for generating a transform of a time-vary- 
ing regularization vector in accordance with said 
raw gain and said differential blur spread; 

(4) means for generating a transform of an impulse 
response in accordance with said time-varying 
regularization vector and said 2N point discrete 
Fourier transforms of said first and second images; 

(5) means for updating said raw gain and said differ- 
ential blur spread in accordance with said impulse 
response; 

(6) means for generating a squared error in accor- 
dance with said impulse response, said updated raw 
gain, and said updated differential blur spread; and 

(7) means for testing said squared error for conver- 
gence. 

27. The apparatus of claim 17, wherein means (c) 20 
comprises means for performing a spatial relaxation 
procedure in accordance with said first and second 
images to generate said differential blur spread. 

28. The apparatus of claim 27, wherein: 
means (c) comprises means for performing said spatial 25 

relaxation procedure in accordance with a forward 
pass through said first and second images to gener- 
ate a plurality of forward differential blur spreads 
and a plurality of forward cost function values; and 
further comprising: 
(d) means for deterrnining a plurality of ranges corre- 
sponding to a plurality of objects in accordance 
with said plurality of forward differential blur 



pies in accordance with said second differential 
blur spread, 

31. The apparatus of claim 30, wherein said first range 
value corresponds to the height of a first stack of nested 
packages and said second range value corresponds to 
the height of a second stack of nested packages. 

32. The apparatus of claim 17, wherein: 
camera (a) comprises a first camera having a focal 

length, an aperture size, and a distance between a 
second principal plane and an image detector plane 
of said first camera, and 
means (c) comprises means for performing said relax- 
ation procedure independent of said focal length, 
said aperture size, and said distance of said first 
camera. 

33. A method for deterrnining a differential blur 
spread corresponding to an object, comprising the steps 
of: 

(a) providing a first image of said object with a first 
camera having a first focal length, a first aperture 
size, a first distance between a second principal 
plane and an image detector plane of said first cam- 
era, and a first camera parameter; 

(b) generating a second image of said object, said 
second image being generated with a camera hav- 
ing a second camera parameter different from said 
first camera parameter, and 

(c) generating said differential blur spread in accor- 
dance with said first and second images and inde- 
pendent of said first focal length, said first aperture 
size, and said first distance of said first camera. 

34. The method of claim 33, further comprising the 
step of: 

(d) determining a range of said object in accordance 

(e) means for perfonning said, spatial relaxation pro- 35 with said differential blur spread. 

cedure in accordance with a backward pass 35. The method of claim 34, further comprising the 
through said first and second images to generate a step of: 

plurality of backward differential blur spreads and (e) focussing a camera in accordance with said range, 
a plurality of backward cost function values; 36. The method of claim 35, wherein said object is a 

(f) means for comparing said plurality of backward 40 package on a conveyor system and said focussed cam- 
cost function values with said plurality of forward era is a high-resolution camera positioned overhead said 
cost function values; and conveyor system to generate images used to read a label 

(g) means for updating said plurality of ranges in on said package. 

accordance with said comparison of means (f). 37. The method of claim 33, wherein said first camera 

29. The apparatus of claim 17, wherein means (c) 45 parameter is a first focal gradient and said second cam- 



30 



comprises: 

(1) means for: 

(a) selecting a first first-image sample from said first 
image and a corresponding first second-image 
sample from said second image, and 

(b) selecting a second first-image sample from said 
first image and a corresponding second second- 
image sample from said second image; and 

(2) means for: 



era parameter is a second focal gradient 

38. The method of claim 33, wherein step (b) com- 
prises the step of generating said second image with a 
second camera having a second aperture size, said sec- 

50 ond aperture size being different from said first aperture 
size. 

39. The method of claim 33, wherein step (b) com- 
prises the step of generating said second image with a 
second camera having a second focal length, said sec- 



(a) generating a first differential blur spread in 55 ond focal length being different from said first focal 



accordance with said first first-image and first 
second-image samples, and 
(b) generating a second differential blur spread in 
accordance with said second first-image and 
second second-image samples, 
30. The apparatus of claim 29, further comprising: 
(d) means for: 
(1) detennining a first range value corresponding 
to said first first-image and second-image sam 



length. 

40. The method of claim 33, wherein step (b) com- 
prises the step of generating said second image with a 
second camera having a second distance between a 

60 second principal plane and an image detector plane of 
said second camera, said second distance being different 
from said first distance. 

41. The method of claim 33, wherein step (c) com- 



prises the step of performing a temporal relaxation pro- 
pies in accordance with said first differential blur 65 cedure in accordance with said first and second images 
spread; and to generate said differential blur spread. 

(2) deterrnining a second range value corresponding 42. The method of claim 33, wherein step (c) corn- 
to said second first-image and second-image sam- prises the steps of: 
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(1) generating a 2N point discrete Fourier transform 
of said first image; 

(2) generating a 2N point discrete Fourier transform . 
of said second image; 

(3) generating a raw gain and said differential blur 5 
spread in accordance with said 2N point discrete 
Fourier transforms of said first and second images; 

(4) generating a transform of a time-varying regular- 
ization vector in accordance with said raw gain and 
said differential blur spread; 10 

(5) generating a transform of an impulse response in 
accordance with said time-varying regularization 
vector and said 2N point discrete Fourier trans- 
forms of said first and second images; . 

(6) updating said raw gain and said differential blur IS 
spread in accordance with said impulse response; 

(7) generating a squared error in accordance with 
said impulse response, said updated raw gain, and 
said updated differential blur spread; 

(8) testing said squared error for convergence; and 20 

(9) repeating steps (c)(4) through (c)(7) in accordance 
with said testing of step (c)(8). 

43. The method of claim 33, wherein step (c) com- 
prises the step of performing a spatial relaxation proce- 
dure in accordance with said first and second images to 25 
generate said differential blur spread. 

44. The method of claim 43, wherein: 

step (c) comprises the step of performing said spatial 
relaxation procedure in accordance with a forward 
pass through said first and second images to gener- 30 
ate a plurality of forward differential blur spreads 
and a plurality of forward cost function values; and 
further comprising the steps of: 

(d) determining a plurality of ranges corresponding to 

a plurality of objects in accordance with said plu- 35 
rality of forward differential blur spreads; 

(e) performing said spatial relaxation procedure in 
accordance with a backward pass through said first 
and second images to generate a plurality of back- 
ward, differential blur spreads and a plurality of 40 
backward cost function values; 

(f) comparing said plurality of backward cost func- 
tion values with said plurality of forward cost func- 
tion values; and 

(g) updating said plurality of ranges in accordance 45 
with said comparison of step (f). 

45. The method of claim 33, wherein step (c) com- 
prises the steps of: 

(1) selecting a first first-image sample from said first 
image and a corresponding first second-image sam- 50 
pie from said second image; 

(2) generating a first differential blur spread in accor- 
dance with said first first-image and first second- 
image samples; 

(3) selecting a second first-image sample from said 55 
first image and a corresponding second second- 
image sample from said second image; and 

(4) generating a second differential blur spread in 
accordance with said second first-image and sec- 
ond second-image samples. 60 

46. The method of claim 45, further comprising the 
steps of: 

(d) determining a first range value corresponding to 
said first first-image and second-image samples in 
accordance with said first differential blur spread; 65 
and 

(e) determining a second range value corresponding 
to said second first-image and second-image sam- 
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pies in accordance with said second differential 
blur spread. 

47. The method of claim 46, wherein said first range 
value corresponds to the height of a first stack of nested 
packages and said second range value corresponds to 
the height of a second stack of nested packages. 

48. An apparatus for determining a differential blur 
spread corresponding to an object, comprising: 

(a) a first camera for providing a first image of said 
object, said first camera having a first focal length, 
a first aperture size, a first distance between a sec- 
ond principal plane and an image detector plane of 
said first camera, and a first camera parameter; 

(b) means, having a second camera parameter, for 
generating a second image of said object, said sec- 
ond camera parameter being different from said 
first camera parameter; and 

(c) means for generating said differential blur spread 
in accordance with said first and second images and 
independent of said first focal length, said first 
aperture size, and said first distance of said first 
camera. 

49. The apparatus of claim 48, further comprising: . 

(d) means for determining a range of said object in 
accordance with said differential blur spread. 

50. The apparatus of claim 49, further comprising: 

(e) means for focussing a camera in accordance with 
said range. 

51. The apparatus of claim 50, wherein said object is 
a package on a conveyor system and said camera is a 
high-resolution camera positioned overhead said con- 
veyor system to generate images used to read a label on 
said package. 

52. The apparatus of claim 48, wherein said first cam- 
era parameter is a first focal gradient and said second 
camera parameter is a second focal gradient 

53. The apparatus of claim 48, wherein means (b) 
comprises a second camera having a second aperture 
size, said second aperture size being different from said 
first aperture size. 

54. The apparatus of claim 48, wherein means (b) 
comprises a second camera having a second focal 
length, said second focal length being different from 
said first focal length. 

55. The apparatus of claim 48, wherein means (b) 
comprises a second camera having a second distance 
between a second principal plane and an image detector 
plane of said second camera, said second distance being 
different from said first distance. 

56. The apparatus of claim 48, wherein means (c) 
comprises means for performing a temporal relaxation 
procedure in accordance with said first and second 
images to generate said differential blur spread. 

57. The apparatus of claim 48, wherein means (c) 
comprises: 

(1) means for generating a 2N point discrete Fourier 
transform of said first image and for generating a 
2N point discrete Fourier transform of said second 



(2) means for generating a raw gain and said differen- 
tial blur spread in accordance with said 2N point 
discrete Fourier transforms of said first and second 
images; 

(3) means for generating a transform of a time-vary- 
ing regularization vector in accordance with said 
raw gain and said differential blur spread; 

(4) means for generating a transform of an impulse . 
response in accordance with said time-varying 
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regularization vector and said 2N point discrete 
Fourier transforms of said first and second images; 

(5) means for updating said raw gain and said differ- 
ential blur spread in accordance with said impulse 

. response; 5 

(6) means for generating a squared error in accor- 
dance with said impulse response, said updated raw 
gain, and said updated differential blur spread; and 

(7) means for testing said squared error for conver- 
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58. The apparatus of claim 48, wherein means (c) 
comprises means for performing a spatial relaxation 
procedure in accordance with said .first and second 
images to generate said differentia] blur spread. 

59. The apparatus of claim 58, whierein; 15 
means (c) comprises means for performing said spatial 

relaxation procedure in accordance with a forward 
pass through said first and second images to gener- 
ate a plurality of forward differential blur spreads 
and a plurality of forward cost function values; and 
further comprising: 

(d) means for determining a plurality of ranges corre- 
sponding to a plurality of objects in accordance 
with said plurality of forward differential blur 
spreads; 

(e) means for performing said spatial relaxation pro- 
cedure in accordance with a backward pass 
through said first and second images to generate a 
plurality of backward differential blur spreads and 3Q 
a plurality of backward cost function values; 

(f) means for comparing said plurality of backward 
cost function values with said plurality of forward 
cost function values; and 

(g) mean for updating said plurality of ranges in ac- 35 
cordance with said comparison of means (f). 

60. The apparatus of claim 48, wherein means (c) 
comprises: 

(1) means for: 

(a) selecting a first first-image sample from said first 40 
image and a corresponding first second-image 
sample from said second image, and 

(b) selecting a second first-image sample from said 
first image and a corresponding second second- 
image sample from said second image; and 43 

(2) means for: 

(a) generating a first differential blur spread in 
accordance with said first first-image and first 
second-image samples, and 

(b) generating a second differential blur spread in so 
accordance with said second first-image and 
second second-image samples. 

61. The apparatus of claim 60, further comprising: 
(d) means for: 

(1) determining a first range value corresponding 55 
to said first first-image and second-image sam- 
ples in accordance with said first differential blur 
spread; and 

(2) determining a second range value correspond- 
ing to said second first-image and second-image 60 
samples in accordance with said second differen- 
tial blur spread. 

62. The apparatus of claim 61, wherein said first range 
value corresponds to the height of a first stack of nested 
packages and said second range value corresponds to 63 
the height of a second stack of nested packages. 

63. The method of claim 1, wherein step (c) com- 
prises the steps of: 



(1) generating an initial differential blur spread in 
accordance with said first and second images; and 

(2) performing a recursive relaxation procedure in 
accordance with said first and second images and 
said initial differential blur spread to generate an 
improved differential blur spread. 

64. The method of claim 1, wherein step (c) com- 
prises the steps of: 

(1) generating a 2N point discrete Fourier transform 
of said first image; , 

(2) generating a 2N point discrete Fourier transform 
of said second image; 

(3) generating an initial gain and an initial differential 
blur spread in accordance with said 2N point dis- 
crete Fourier transforms of said first and second 



(4) generating the discrete Fourier transform of a 
time-varying regularization vector in accordance 
with said initial gain and said initial differential blur 
spread; 

(5) generating the discrete Fourier transform of the 
differential impulse response between said camera 
of step (a) and said camera of step (b) in accordance 
with said discrete Fourier transformed time-vary- 
ing regularization vector; 

(6) updating said initial gain and said initial differen- 
tial blur spread in accordance with said discrete 
Fourier transformed differential impulse response; 

(7) generating a squared error in accordance with 
said discrete Fourier transformed differential im- 
pulse response, said updated gain, and said updated 
differential blur spread; 

(8) testing for the convergence of said squared error; 
and 

(9) repeating steps (c)(4) through (c)(7), in accor- 
dance with said testing of step (c)(8), using said 
updated gain and said updated differential blur 
spread. 

65. The method of claim 64, wherein step (c)(4) em- 
ploys a gaussian blur model. 

66. The method of claim 64, wherein step (c)(4) em- 
ploys a cylindrical sine blur model. 

67. The method of claim 1, where step (c) comprises 
the steps of: 

(1) setting an initial differential blur spread equal to 
1.0; 

(2) performing a forward pass through said first and 
second images to generate a plurality of forward 
differential blur spreads and a plurality of forward 
cost function values using local recursive parame- 
ter adaption in the spatial domain; 

(3) performing a backward pass through said first and 
second images, starting where the forward pass 
ended, to generate a plurality of backward differen- 
tial blur spreads and a plurality of backward cost 
function values using local recursive parameter 
adaption in the spatial domain; and 

(4) selecting a plurality of local differential blur 
spreads corresponding to a plurality of image pixel 
locations, whereby each local differential blur 
spread is selected from a corresponding local for- 
ward differential blur spread and a corresponding 
local backward differential blur spread in accor- 
dance with the minimum of a corresponding local 
forward cost function value and a corresponding 
local backward cost function value. 

68. The method of claim 67, wherein step (c) further 
comprises the step of: 
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(5) generating a plurality of range values from said 
plurality of local differential blur spreads, wherein 
each range value corresponds to an image pixel 
location. 

69. The method of claim 3, wherein step (e) comprises 5 
the step of time-delayed focussing the focussed camera, 
said focussed camera being located overhead a con- 
veyor system downstream of said camera used to gener- 
ate said first image and said camera used to generate 
said second image. 10 

70. The apparatus of claim 17, wherein means (c) 
comprises: 

(1) means for generating an initial differential blur 
spread in accordance with said first and second 
images; and IS 

(2) means for performing a recursive relaxation pro- 
cedure in accordance with said first and second 
images and said initial differential blur spread, to 
generate an improved differential blur spread. 

71. The apparatus of claim 17, wherein means (c) 20 
comprises: 

(1) means for generating a 2N point discrete Fourier 
transform of said first image; 

(2) means for generating a 2N point discrete Fourier 
transform of said second image; 25 

(3) means for generating an initial gain and an initial 
differential blur spread in accordance with said 2N 
point discrete Fourier transforms of said first and 
second images; 

(4) means for generating the discrete Fourier trans- 30 
form of a time-varying regularization vector in 
accordance with said initial g«tn and said initial 
differential blur spread; 

(5) means for generating the discrete Fourier trans- 
form of the differential impulse response between 35 
said camera (a) and said camera means (b) in accor- 
dance with said discrete Fourier transformed time- 
varying regularization vector; 

(6) means for updating said initial gain and said initial 
differential blur spread in accordance with said 40 
discrete Fourier transformed differential impulse 
response; 

(7) means for generating a squared error in accor- 
dance with , said discrete Fourier transformed dif- 
ferential impulse response, said updated gain, and 45 
said updated differential blur spread; 

(8) means for testing for the convergence of said 
squared error; and 

(9) means for repeating the operations of means (c)(4) 
through (c)(7), in accordance with said testing of 50 
means (c)(8), using said updated gain and said up- 
dated differential blur spread. 

72. The apparatus of claim 71, wherein means (c)(4) 
employs a gaussian blur model. 

73. The apparatus of claim 71, wherein means (c)(4) 55 
employs a cylindrical sine blur model. 

74. The apparatus of claim 17, where means (c) com- 
prises: 

(1) means for setting an initial differential blur spread 
equal to 1.0; . 60 

(2) means for performing a forward pass through said 
first and second images to generate a plurality of 
forward differential blur spreads and a plurality of 
forward cost function values using local recursive 
parameter adaption in the spatial domain; 65 

(3) means for performing a backward pass through 
said first and second images, starting where the 
forward pass ended, to generate a plurality of back- 
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ward differential blur spreads and a plurality of 
backward cost function values using local recur- 
sive parameter adaption in the spatial domain; and 

(4) means for selecting a plurality of local differential 
blur spreads corresponding to a plurality of image 
pixel locations, whereby each local differential blur 
spread is selected from a corresponding local for- 
ward differential blur spread and a corresponding 
local backward differential blur spread in accor- 
dance with the minimum of a corresponding local 
forward cost function value and a corresponding 
local backward cost function value. 

75. The apparatus of claim 74, wherein means (c) 
further comprises: 

(5) means for generating a plurality of range values 
from said plurality of local differential blur spreads, 
wherein each range value corresponds to an image 
pixel location. 

76. The apparatus of claim 19, wherein means (e) 
comprises the means for time-delayed focussing the 
focussed camera, said focussed camera being located 
overhead a conveyor system downstream of said cam- 
era used to generate said first image and said camera 
used to generate said second image. 

77. The method of claim 1, wherein step (a) further 
comprises the step of: 

(1) generating a calibration mapping corresponding 
to a plurality of test differential blur spreads and a 
plurality of test range values. 

78. The method of claim 77, wherein step (a)(1) com- 
prises the steps of: 

(A) providing a test object corresponding to a test 
range value; 

(B) generating a test image corresponding to said test 
object; 

(C) generating a test differential blur spread corre- 
sponding to said test image; 

(D) repeating steps (a)(1)(A) through (a)(1)(C) for a 
plurality of test range values to generate a plurality 
of test differential blur spreads; and 

(E) generating said calibration mapping by minimiz- 
ing a cost function in accordance with said plural- 
ity of test range values and said plurality of test 
differential blur spreads. 

79. The method of claim 3, wherein step (a) further 
comprises the step of: 

(1) generating a calibration mapping corresponding 
to a plurality of test differential blur spreads and a 
plurality of test range values. 

80. The method of claim 79, wherein step (a)(1) com- 
prises the steps of: 

(A) generating a first test image corresponding to a 
test object using said camera having said first cam- 
era parameter; 

(B) generating a second test image corresponding to 
said test object using said camera having said sec- 
ond camera parameter; 

(Q generating a test differential blur spread corre- 
sponding to said first and second test images; 

(D) generating a third test image with a test focussing 
camera, said third test image corresponding to said 
test differential blur spread; 

(E) determining a test focus distance corresponding 
to said test focussing camera during step (a)(1)(D); 

(F) repeating steps (a)(1)(A) through (a)(1)(E) for a 
plurality of test differential blur spreads; and 

(G) generating said calibration mapping by minimiz- 
ing a cost function in accordance with said plural- 
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ity of test differential blur spreads and said plurality 
of test focus distances. 

81. The apparatus of claim 17, wherein means (c) 
comprises means for generating a calibration mapping 
corresponding to a plurality of test differential blur 
spreads and a plurality of test range values. 

82. The apparatus of claim 81, wherein means (c) 
comprises: 

(1) test camera means for generating a plurality of test 
images corresponding to a plurality of test objects 
corresponding to said plurality of test range values; 

(2) means for generating said plurality of test differen- 
tial blur spreads corresponding to said plurality of 
test images; and 

(3) means for generating said calibration mapping by 
minimizing a cost function in accordance with said 
plurality of test range values and said plurality of 
test differential blur spreads. 

83. The apparatus of claim 19, further comprising: 
(f) means for generating a calibration mapping corre- 
sponding to a plurality .of test differential blur 
spreads and a plurality of test focus distances. 

84. The apparatus of claim 83, wherein means (f) 
comprises: 

(1) test camera means, having said first camera pa- 
rameter, for generating a plurality of first test im- 
ages corresponding to a test object; 

(2) test camera means, having said second camera 
parameter, for generating a plurality of second test ^ 
images corresponding to said test object; 

(3) means for generating said plurality of test differen- 
tial blur spreads corresponding to said pluralities of 
first and second test images; 

(4) a test focussing camera for generating a plurality 
of third test images, said plurality of third test im- 
ages corresponding to said plurality of test differ- 
ential blur spreads; 

(5) means for determining said plurality of test focus 
distances corresponding to said test focussing cam- 
era; and 

(6) means for generating said calibration mapping by 
minimizing a cost function in accordance with said 
plurality of test differential blur spreads and said 
plurality of test focus distances. 

85. An apparatus for determining a differential blur 
spread corresponding to object, comprising: 

(a) camera means, having a first camera parameter, 
for providing a first image of said object; 
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(b) camera means, having a second camera parame- 
ter, or providing a second image of said object, said 
second camera, parameter being different from said 
first camera parameter, 

(c) means for performing a relaxation procedure in 
accordance with said first and. second images to 
generate said differential blur spread; 

(d) means for determining a range of said object in 
accordance with said differential blur spread; and 

(e) means for focussing a camera in accordance with 
said range. 

86. The apparatus of claim 85, wherein said object is 
a package on a conveyor system and said camera is a 
high-resolution camera positioned overhead said con- 
veyor system to generate images used to read a label on 
said package. 

87. The apparatus of claim 85, wherein means (e) 
comprises the means for time-delayed focussing the 
focussed camera, said focussed camera being located 
overhead a conveyor system downstream of said cam- 
era used to generate said first image and said camera 
used to generate said second image. 

88. The apparatus of claim 85, further comprising: 
(0 means for generating a calibration mapping corre- 
sponding to a plurality of test differential blur 
spreads and a plurality of test focus distances. 

89. The apparatus of claim 88, wherein means (f) 
comprises: 

(1) test camera means, having said first camera pa- 
rameter, for generating a plurality of first test im- 
ages corresponding to a test object; 

(2) test camera means, having said second camera 
parameter, for generating a plurality of second test 
images corresponding to said test object; 

(3) means for generating said plurality of test differen- 
tial blur spreads corresponding to said pluralities of 
first and second test images; 

(4) a test focussing camera for generating a plurality 
of third test images, said plurality of third test im- 
ages corresponding to said plurality of test differ- 
ential blur spreads; 

(5) means for detenrnning said plurality of test focus 
distances corresponding to said test focussing cam- 
era; and 

(6) means for generating said calibration mapping by 
minimizing a cost function in accordance with said 
plurality of test differential blur spreads and said 
plurality of test focus distances. 
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